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Abstract 

The  goal  for  the  initial  phase  of  the  systems  engineering  Experience  Accelerator  (ExpAcc) 
research  project  is  to  demonstrate  the  ability  to  leverage  technology  to  accelerate  the  time  it  takes 
to  mature  a  systems  engineer.  To  demonstrate  this  goal,  the  ExpAcc  team  is  developing  a  proto¬ 
type  simulator  for  demonstrating  the  ability  to  increase  the  learner’s  proficiency  in  a  selected 
area  of  systems  engineering  competency.  As  an  initial  step  in  the  project,  a  systems  engineering 
competency  taxonomy  was  built  from  a  selected  set  of  existing  competency  models  combined 
with  systems  thinking  research.  The  final  competency  taxonomy  covers  87  unique  competencies 
and  includes  a  proficiency  table  based  on  the  learner’s  level  of  self-assessed  and  demonstrated 
ability.  This  paper  describes  in  detail  the  approach  used  to  develop  the  competency  model  for  the 
ExpAcc  research  project,  and  describes  in  more  detail  the  primary  areas,  categories,  subgroups, 
and  individual  capabilities,  as  well  as  the  proficiency  matrix,  that  together  fonn  the  taxonomy. 

Introduction 

Due  to  a  real-time  shortage  in  systems  engineers  (Goncalves,  2010;  NDIA  SE  Division, 
2010;  Squires  and  Cloutier,  2010),  a  flurry  of  activity  to  develop  systems  engineering  compe¬ 
tency  models  has  occurred  over  the  past  decade  (Squires,  2011;  Ferris,  2010;  Kasser,  2010). 
Government,  industry  and  academia  rely  on  these  competency  models  to  identify  critical  compe¬ 
tencies  of  systems  engineers.  In  particular,  systems  engineering  competency  models  are  becom¬ 
ing  more  widely  developed  and  used  in  support  of  systems  engineering  workforce  selection,  de¬ 
velopment,  education  and  training  (Burke,  et.  al.,  2000;  Jansma  and  Jones,  2006;  Venna,  Larson, 
and  Bromley,  2008;  Menrad  and  Larson,  2008;  Squires,  Larson,  and  Sauser,  2010).  In  order  to 
define  a  competency  model  for  lead  program/technical  systems  engineers  in  the  acquisition 
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community,  the  Experience  Accelerator  (ExpAcc)  research  project  chose  to  take  advantage  of 
existing  competency  model  development  efforts  rather  than  develop  a  completely  new  model. 
The  team  combined  the  following  three  models  into  a  single  competency  taxonomy  as  the  guid¬ 
ing  competency  model  for  the  project: 

1)  The  Systems  Planning,  Research  Development,  and  Engineering  (SPRDE)  Systems  En¬ 
gineering  (SE)  and  Program  Systems  Engineer  (PSE)  competency  model,  known  as  the 
SPRDE-SE/PSE.  (DAU,  2010) 

2)  The  SERC  Technical  Lead  Competency  Model  (Gavito,  et.  al,  December,  2010) 

3)  A  Critical/Systems  Thinking  Competency  Model  (Squires,  2007) 

A  summary  of  these  models  can  be  found  in  Appendix  A.  The  final  ExpAcc  competency  taxon¬ 
omy  has  six  primary  groupings  as  shown  in  Figure  1,  that  are  further  divided  into  two  to  six 
competency  areas  that  contain  a  total  of  87  unique  competencies.  The  model  includes  a  profi¬ 
ciency  table  that  measures  the  learner’s  proficiency  level  in  each  competency  based  on  the  com¬ 
plexity  of  the  system  being  simulated  and  the  learner’s  level  of  demonstrated  ability  to  apply  the 
competency  for  each  level  of  complexity. 

Background 

The  growing  gap  in  systems  engi¬ 
neering  talent  may  be  attributed  to  a 
combination  of  factors,  including: 

1)  an  increasing  need  for  systems 

engineers,  driven  by  such  trends 

as: 

•  increasing  complexity  in  con¬ 
temporary  systems  (Davidz,  et. 
al.  2005;  Goncalves,  2008; 

Kalawsky,  2009), 

•  life  extensions  of  legacy  sys¬ 
tems  (Sireli  and  Mengers, 

2009),  and 

•  a  growing  need  for  solving 
global  sustainment  challenges 
(Richmond,  1993:  INCOSE 
Technical  Operations,  2007); 
and 

2)  a  depletion  of  systems  engineers  due  to  such  trends  as: 

•  an  aging  and  retiring  baby  boom  generation,  and 

•  an  historical  decrease  in  the  United  States  in  the  interest/graduates  in  Science,  Technology, 
Engineering  and  Mathematics  (STEM)  fields  in  the  generations  following. 

This  gap  has  created  an  urgent  need  to  accelerate  the  time  to  mature  a  systems  engineer,  and 
the  ExpAcc  research  project  is  focused  on  demonstrating  the  feasibility  of  achieving  this  accel¬ 
eration  through  the  development  of  an  engaging,  realistic  and  authentic  experiential-based  simu¬ 
lator  prototype. 
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The  ExpAcc  Competency  Taxonomy 


One  goal  of  the  ExpAcc  simulator  is  to  increase  the  learner’s  level  of  systems  engineering 
competency  with  each  use.  To  address  this,  a  baseline  competency  taxonomy  was  developed  for 
use  in  identifying  the  total  set  of  competencies  being  targeted.  The  developed  competency  tax¬ 
onomy  is  based  on  a  three-pronged  approach.  As  shown  in  Figure  1,  the  backbone  (shown  in  the 
center)  of  the  model  is  systems  and  critical  thinking.  The  second  prong  represented  by  the  three 
upper  circles  in  Figure  1,  is  technical  expertise  and  comprises  technical  leadership,  technical 
management,  and  technical/analytical  skills  as  shown  in  Figure  2.  The  third  prong  shown  in  the 
two  lower  circles  of  Figure  1,  and  expanded  in  Figure  3,  comprises  project  management  and 
other  broad-based  professional  competencies. 


Systems  and  Critical 
Thinking 

Systems  thinking  is  the 

ability  to  think  abstractly  in  order 

to: 

•  incorporate  multiple 

perspectives; 

•  work  within  a  space  where  the 
boundary  or  scope  of  problem 
or  system  may  be  “fuzzy”; 

•  understand  diverse  operational 
contexts  of  the  system; 

•  identify  inter-  and  intra¬ 
relationships  and 

dependencies; 

•  understand  complex  system 
behavior;  and  most  important 
of  all, 

•  reliably  predict  the  impact  of 
change  to  the  system. 


Technical 

Leadership 

Enterprise 

Leadership 


Enterprise 

Management 


Figure  2:  Technical  Expertise 


Figure  3:  Domain  Independent 


Critical  thinking  refers  to  a 
rigorous  analytical  approach  to 
thinking  and  in  this  model  is 
comprised  of  strategic  and 
essential  thinking.  Strategic 
thinking  focuses  on  the  long-term 
interests  of  the  institution  in  a 
global  environment.  Essential 
thinking  focuses  on  the  ability  to 
quickly  narrow  in  on  the  concepts 
that  are  essential  to  the 
opportunity  or  solution  at  hand. 
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Technical  Expertise 

Technical  expertise  includes  the  three  groups,  each  with  three  to  five  competency  areas, 
shown  in  Figure  2.  Technical  Leadership  includes  areas  needed  to  effectively  lead  the  team  in 
systems  engineering  activities.  Technical  Management  focuses  on  managing  systems  engineering 
processes.  Technical/ Analytical  skills  includes  those  competencies  necessary  for  implementing 
systems  engineering. 

Technical  Leadership 

Technical  leadership  pertains  to 
competencies  needed  to  direct  the 
enterprise  and  includes  specialty 
foci  on  risk,  safety,  physical  and 
cyber  security,  and  environment  and 
ecology  at  the  enterprise  level. 

These  areas  are  divided  into  the  9 
individual  competencies  in  Table  1. 


Table  1.  Technical  Leadership  Competencies 


I  Technical  Leadership 

Enterprise  Leadership 

Leading  the  Technical  Enterprise 

Governance  for  the  Technical  Enterprise 

Enterprise 

Management 

Organizational  Structure,  Mission,  Internal  Goals 

Knowledge  Capture,  IP,  Capture  and  Sharing 

International  Standards  and  Political  Implications 

Enterprise  Risk  and 
Security 

Risk  Management  Process 

Safety 

Physical  and  Cyber  Security 

Environment  and  Ecology 

Table  2.  Technical  Management  Competencies 


Technical  Management 

System  Definition 
Management 

Stakeholder  Expectations  and  Management 

Technical  Requirements  Definition  and 

Interface  Definition 

Concept  of  Operations  (CONOPS) 

Systems  of  Systems  (SoS)  Architecture 

Concepts  and  Architecture 

Trade  Studies 

Design  Solution  Definition 

System  Environments 

Logical  Decomposition 

System  Realization 
Management 

Product  Integration 

Product  Verification 

Product  Validation 

System  Deployment, 
Use  and  Life 
Management 

Operations 

Product  Transition 

Logistics  Management 

Project  Processes 
Management 

Technical  Planning 

Technical  Risk  Management 

Technical  Assessment 

Software  Challenges,  Solutions,  Engineering 

Configuration  Management 

Interface  Management 

Process  Assessment  and  Control 

Technical  Data  Management 

Technical  Decision  Analysis 

Quantitative  Techniques 

Overall  Technical 
Management 

PM/SE  Procedures  and  Guidelines 

Systems  Engineering  Management 

Acquisition  Phases  Management 

Technical  Management 

Technical  management 
addresses  managing  the 
system  life  cycle  and  project 
management  processes  with  a 
focus  on  the  technical  aspects 
and  includes  the  systems 
engineering  management 
competencies.  These  areas  are 
divided  into  the  29  individual 
competencies  in  Table  2. 

Technical/Analytical 

Tec  h  n  i  ca  1/ A  n  a  I  y  ti  c  a  I 
includes  competencies 

required  to  implement 
systems  engineering  across 
the  systems  life  cycle.  This 
competency  area  also  covers 
the  specialties  and  domain 
centric  competencies.  These 
areas  are  divided  into  the  16 
individual  competencies  in 
Table  3. 
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Domain  Independent 

Project  management  and  other 
broad-based  professional 

competencies,  are  important  for  lead 
program  system  engineers.  For  this 
reason,  these  critical  competency 
areas  are  included  in  the  ExpAcc 
competency  taxonomy.  Table  4  lists 
the  project  management 

competencies,  and  Table  5  focuses  on 
broad-based  professional 

competencies. 


Competency  Assessment 


Competency  assessment  in  the 
ExpAcc  simulator  begins  with  the 
learner’s  self-ratings  of  their 
proficiency.  These  self-ratings 

support  skill  development 
in  two  related  ways.  First, 
the  assessment  is 
prescriptive  exposing 
learners  to  examples  of 
effective  behavior  (Van 
Velsor  and  Leslie,  1991). 
They  also  establish  a 
standard  against  which  to 
provide  learners  with 
subsequent  feedback  on 
their  actual  performance 
in  the  ExpAcc  and 
thereby  to  further  focus 
and  facilitate 

developmental  goal 

setting  (e.g.,  Carver  & 
Scheier,  1981)  For  the 
prototype  model,  the  team 
chose  to  focus  initially  on 
one  competency: 

“Problem  Solving  and 
Recovery  Approach.” 
This  competency 

comprises  several 

important  elements: 


Table  4.  Project  Management  Competencies 


Project  Management 

Resource  Management 

Technical  Staffing  and  Performance 

Position  Management 

Business  Acumen 

Budget  and  Full  Cost  Management 

Capital  Management 

Business  Engineering 

External  Relationships 

Integration  of  Technical  Programs  and  Portfolios 

Lifecycle  Perspective 

Management  of  Research  and  Development 

Project  Conception 

Needs  or  Opportunity  Management 

Project  Proposal  and  Bid  Management 

Requirements  Management 

Acquisition  Strategies,  Procurements  and 
Management 

Project  Planning, 
Management  and 
Control 

Project  Review  and  Evaluation 

Resource  Management 

Contract  Management 

Project  Planning 

Project  Control 

Lifecycle  Cost  Estimating 

Tracking/Trending  of  Project  Performance 

Information  Technology/Management 

Information  Systems 

Mission  Assurance  and  Specialty  Engineering 

Table  3.Technical/Analytical  Competencies 


j  Technical/Analytical  I 

Domain  Expertise 

Technical  Discipline  Expertise 

Domain  Application  Areas 

Domain  Methods,  Processes,  and  Tools 

System  Definition 

Technical  Basis  for  Cost 

Modeling  and  Simulation 

Safety  Assurance 

Stakeholder  Requirements  Definition 

Requirements  Analysis 

Architectural  Design 

System  Realization 

Implementation 

Integration 

Verification 

Validation 

System  Deployment 
and  Use 

Transition 

System  Assurance 

Reliability,  Availability,  and 
Maintainability  (RAM) 
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•  Identifying  the  actual  /root  cause 
problems  amid  often  conflicting 
information. 

•  Marshalling  the  resources 
needed  to  solve  problems. 

•  Recognizing  the  problems  that 
have  the  most  impact  to  the 
overall  system  and  appropriately 
prioritizing  plans  for  solving 
them. 

•  Making  recommendations,  using 
technical  knowledge  and 

experience,  by  developing  a  clear  understanding  of  the  system. 

•  Identifying  and  analyzing  problems  using  a  systems  approach,  weighing  the  relevance  and 
accuracy  of  information,  accounting  for  interdependencies,  and  evaluating  alternative  solu¬ 
tions. 

Table  6  shows  how  the  definition  of  that  competency  breaks  out  into  1 1  individual  behavioral 
elements  that  can  then  be  presented  to  the  learner  for  self-assessment. 


Table  5.  Broad  Professional  Competencies 


Broad/Professional 

Professional 
Leadership  and 
Development 

Leadership 

Communication 

Professional  Ethics 

Mentoring  and  Coaching 

Team  Dynamics  and  Management 

Multinational  and  Multicultural  Issue 

Program  Assessment 
and  Recovery 

Review  and  Assessment  Process 

Problem  Solving  and  Recovery  Approach 

Solution  Definition  and  Lateral  Thinking 

Table  6.  Behavioral  Statements  for  Self-Assessment 


1.  Self-Assessment:  Problem  Solving  and  Recovery  Approach 


This  survey  requires  you  to  assess  the  extent  to  which  you  are  confident  in  your  effectiveness  at  performing  several  key  behaviors 
pertaining  to  Problem  Solving  and  Recovery  Approach.  First,  read  the  definition  below  and  then  for  each  item  in  the  survey  choose  the 
response  that  most  accurately  describes  your  confidence  in  your  current  level  of  effectiveness. 

Problem  Solving  and  Recovery  Approach  -  Identifying  the  actual  /root  cause  problems  amidst  often  conflicting  information.  Marshaling 
the  resources  needed  to  solve  problems.  Recognizing  the  problems  that  have  the  most  impact  to  the  overall  system  and  appropriately 
prioritizing  plans  for  solving  them.  Making  recommendations,  using  technical  knowledge  and  experience,  by  developing  a  clear 
understanding  of  the  system.  Identifying  and  analyzing  problems  using  a  systems  approach,  weighing  the  relevance  and  accuracy  of 
information,  accounting  for  interdependencies,  and  evaluating  alternative  solutions. 

Use  the  following  definitions  for  the  rating  scale: 

-  Not  at  all  Confident:  I  have  very  little  competence  or  experience. 

-  Somewhat  Confident:  I  have  some  competence  but  this  is  an  important  area  for  me  to  develop. 

-  Confident:  My  competence  in  this  area  is  sufficient. 

-  Very  Confident:  This  is  a  strength  for  me. 


Please  respond  to  the  following  statements  with  the  rating  that  best  reflects  your  current  confidence  level  in  each. 


Not  at  all  Confident 

Somewhat 

Confident 

Confident 

Very  Confident 

1.  Ensuring  that  people  openly  share  knowledge  and  information 

["” 

r— 

r 

r— 

2.  Creating  a  climate  that  enables  others  to  feel  safe  raising  questions  or 

r- 

|— 

r 

r— 

concerns 

3.  Proactively  seeking  out  new  information  and  perspectives,  rather  than  waiting 
for  others  to  raise  problems  or  concerns 

r— 

r 

r— 

4.  Remaining  open  to  information  that  does  not  confirm  your  own  views  and 
assumptions  (e.g.  goes  against  the  status  quo  or  prevailing  wisdom) 

r 

p 

r 

r— 

5.  Testing  your  own  and  other's  assumptions 

r— 

r 

r— 

6.  Approaching  problems  from  a  systems  perspective  -one  that  recognizes 

r" 

i— 

i~ 

■— 

independencies  and  relationships 

7.  Recognizing  potentially  overlooked  consequences  of  decisions  and  courses  of 

action 

j^- • 

r— 

r 

8.  Avoiding  premature  closure-ensuring  that  problem  causes  and  recovery 
options  are  sufficiently  explored  before  settling  on  courses  of  action 

r~~ 

r— 

r 

r— 

9.  Using  technical  proficiency  to  identify  and  solve  problems 

r 

r— 

r 

r— 

10.  Changing  direction  based  upon  new  knowledge  and  information 

r~ 

i — 

r— 

r— 

11.  Following  through  to  ensure  that  changes  are  implemented  properly 

r— 

r— 

r 

r— 
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Proficiency  Scale 


In  future  versions  of  the  ExpAcc,  the  intent  is  for  the  user  to  progress  -  over  time  -  to  increas¬ 
ingly  more  complex  situations  (by  level)  in  the  simulation  and  from  beginning  to  advanced 
stages  of  capability  and  understanding  in  each  situational  context.  This  is  illustrated  by  the  profi¬ 
ciency  table  shown  in  Table  7. 


Table  7.  Proficiency  Level  and  Situation  Complexity 


Proficiency  Level 

Situation 

Complexity 

None  or 
Aware 
Only 

Apply 

with 

Guidance 

Apply 

Manage 
or  Lead 

Advance 
State  of 
Art 

Exceptionally 

Complex 

Considerably 

Complex 

Complex 

Somewhat 

Complex 

Simple 

l 

Cj 

Conclusion 

This  paper  described  the  approach  used  to  develop  the  competency  model  for  the  ExpAcc  re¬ 
search  project,  and  describes  the  primary  areas,  categories,  subgroups,  and  individual  capabili¬ 
ties/behavioral  statements,  as  well  as  the  proficiency  matrix,  that  together  form  the  taxonomy. 
We  have  stressed  the  role  the  taxonomy  has  played  in  guiding  the  design  of  the  ExpAcc  simula¬ 
tor.  We  have  also  outlined  how  behavioral  statements  can  be  used  in  the  operational  model  to 
enhance  learning  and  developmental  goal  setting. 

As  the  ExpAcc  project  continues  we  expect  to  learn  more  about  how  best  to  define,  orga¬ 
nize,  and  use  competency  models  to  accelerate  system  engineering  proficiency.  Some  have  ar¬ 
gued  that  competency  models  can  be  overly  prescriptive,  driving  users  to  think  that  there  is  one 
best  way  to  get  results  (e.g.,  McCall,  2010,  Hollenbeck,  McCall  &  Silzer,  2006).  To  date  our 
framework  is  driven  more  by  a  conceptual  rather  than  empirically  derived  understanding  of  rele¬ 
vant  systems  engineering  competencies.  Data  and  information  collected  though  the  ExpAcc  pro¬ 
ject  will  enable  us  to  more  closely  examine  the  inter-relationships  (e.g.,  factor  structure)  of  the 
competencies  we  have  identified  and  to  ultimately  refine  this  model  to  further  enhance  its  accu¬ 
racy  and  relevance  as  a  planning  and  learning  tool. 
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Appendix  A:  Three  Competency  Models 

Each  of  the  competency  models  used  to  create  the  ExpAcc  competency  taxonomy  is  summa¬ 
rized  in  this  appendix. 

SPRDE-SE/PSE  Competency  Model 

The  SPRDE-SE/PSE  competency  model  comprises  29  competency  areas  with  45  unique 
elements  of  competency  defined.  These  are  grouped  according  to  three  primary  “units  of  compe¬ 
tences”  -  analytical,  technical  management,  and  professional.  The  analytical  unit  covers  13  com¬ 
petencies  related  to  the  technical  base  for  cost  and  aspects  of  the  system  life  cycle.  The  technical 
management  unit  addresses  12  competencies  focused  on  the  technical  side  of  project  manage¬ 
ment.  The  professional  unit  covers  the  broader  competencies  of  communication,  problem 
solving,  systems  thinking  and  ethics  (DAU,  2010) 

SERC  Technical  Lead  Competency  Model 

The  SERC  Technical  Lead  Competency  Model  includes  12  primary  categories  of  competen¬ 
cies  and  71  unique  competencies;  the  12  primary  categories  are  (Gavito,  et.  al,  December,  2010): 

1 .  professional  and  leadership  development 

2.  enterprise  leadership  and  management 

3.  resource  management 

4.  business  acumen 

5.  risk  and  security 

6.  program  assessment  and  recovery 

7.  project  conception 

8.  project  planning,  management,  and  control 

9.  systems  engineering  thinking  and  perspective 

10.  technical  management 

1 1 .  production,  product  transition,  and  operations 

12.  technical  acumen 

The  first  1 1  categories  covered  broad  areas  of  systems  engineering  and  technical  leadership 
while  the  12th  category  focuses  on  the  specific  technical  discipline  expertise  and  the  associated 
domain. 

Systems/Critical  Thinking  Competency  Model 

The  systems/critical  thinking  competency  model  (Squires,  2007)  is  summarized  within  the 
section  on  Systems  and  Critical  Thinking  in  the  body  of  the  paper. 
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